METHOD AND SYSTEM FOR ACCESSING INTERACTIVE MULTIMEDIA 
INFORMATION OR SERVICES BY TOUCHING HIGHLIGHTED ITEMS 

ON PHYSICAL DOCUMENTS 



Field of the invention 



'.fa 



The present invention generally relates to interactive 
hypermedia systems and more particularly to a method and system 
for creating hyperlinks from selected items (e.g., words, 
pictures, foot notes, symbols, icons) on hard-copy documents to 
locally or remotely accessible servers, for highlighting by means 
of a light emitting source the position of each selected item, 
and for triggering anyone of said hyperlinks simply by touching 
the hard-copy document over said highlighted items. 




*& 

W " Background of the invention 

Q 

'2 INTERNET 

The Internet is a global network of computers and computers 
^networlcS^^hLe "Net") . The Internet connects computers that use a 
H» variety of drE^ej^snt operating systems or languages, including 
UNIX, DOS, Windows, J^ p ac^iritosh, and others. To facilitate and 
allow the communication ^""Sln^UM these various systems and 
20 languages, the Internet uses a larlTgsa^ge referred to as TCP/IP 
("Transmission Control Protocol/Interneb^Protocol'') . TCP/IP 
protocol supports three basic applications on th><tnternet : 

• transmitting and receiving electronic mail, 

♦ logging into remote computers (the "Telnet") , and 

25 • transferring files and programs from one computer to another 

( "FTP" or "File Transfer Protocol") . 
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WORLD WIDE WEB 

Njjfith the increasing size and complexity of the Internet, 
tools haAT^^b^eri developed to help find information on the 
network, often caTlred^^ navigators or navigation systems. 
Navigation systems that hav£^4a,§en developed include standards 
such as Archie, Gopher and WAIS. Th^-Wprld Wide Web ("WWW" or 
"the Web") is a recent superior navigatiorT^sy^fe^ri. The Web is: 



• an Internet-based navigation system, 

• an information distribution and management system for the 
10 Internet, and 

q • a dynamic format for communicating on the Web. 

j s : 

,£ The Web seamlessly, for the use, integrates format of 
information, including still images, text, audio and video. A 
y user on the Web using a graphical user interface ("GUI", 
't5 pronounced "gooey") may transparently communicate with different 
Q host computers on the system, different system applications 
(including FTP and Telnet), and different information formats for 
|jl files and documents including, for example, text, sound and 

graphics. 



20 HYPERMEDIA 

The Web uses hypertext and hypermedia. Hypertext is a subset 
of hypermedia and refers to computer-based "documents" in which 
readers move from one place to another in a document, or to 
another document, in a non-linear manner. To do this, the Web 
25 uses a client-server architecture. The Web servers enable the 
user to access hypertext and hypermedia information through the 
Web and the user's computer. (The user's computer is referred to 
as a client computer of the Web Server computers.) The clients 
send requests to the Web Servers, which react, search and 
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respond. The Web allows client application software to request 
and receive hypermedia documents (including formatted text, 
audio, video and graphics) with hypertext link capabilities to 
other hypermedia documents, from a Web file server. 

The Web, then, can be viewed as a collection of document 
files residing on Web host computers that are interconnected by 
hyperlinks using networking protocols, forming a virtual "web" 
that spans the Internet. 

UNIFORM RESOURCE LOCATORS 

A resource of the Internet is unambiguously identified by a 
Uniform Resource Locator (URL) , which is a pointer to a 
particular resource at a particular location. A URL specifies the 
protocol used to access a server (e.g. HTTP, FTP,..), the name of 
the server, and the location of a file on that server. 

HYPER TEXT TRANSFER PROTOCOL 

Each Web page that appears on client monitors of the Web may 
appear as a complex document that integrates, for example, text, 
images, sounds and animation. Each such page may also contain 
hyperlinks to other Web documents so that a user at a client 
computer using a mouse may click on icons and may activate 
hyperlink jumps to a new page (which is a graphical 
representation of another document file) on the same or a 
different Web server. 

A Web server is a software program on a Web host computer 
that answers requests from Web clients, typically over the 
Internet. All Web servers use a language or protocol to 
communicate with Web clients which is called Hyper Text Transfer 
Protocol ("HTTP") . All types of data can be exchanged among Web 
servers and clients using this protocol, including Hyper Text 
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Markup Language ("HTML"), graphics, sound and video. HTML 
describes the layout, contents and hyperlinks of the documents 
and pages. Web clients when browsing : 

• convert user specified commands into HTTP GET requests, 

• connect to the appropriate Web server to get information, 
and 

• wait for a response. The response from the server can be the 
requested document or an error message. 

After the document or an error message is returned, the 
connection between the Web client and the Web server is closed. 

First version of HTTP is a stateless protocol. That is, with 
HTTP there is no continuous connection between each client and 
each server. The Web client using HTTP receives a response as 
HTML data or other data. This description applies to version 1.0 
of HTTP protocol, while the new version 1.1 breaks this barrier 
of stateless protocol by keeping the connection between the 
server and client alive under certain conditions. 

BROWSER 

After receipt, the Web client formats and presents the data 
or activates an ancillary application such a sound player to 
present the data. To do this, the server or the client determines 
the various types of data received. The Web Client is also 
referred to as the Web Browser, since it in fact browses 
documents retrieved from the Web Server. 

INTERACTIVE ACCESS TO MULTIMEDIA SERVICES 

Interactive electronic services, video-on-demand, and the 
World Wide Web are providing access to an increasing offering of 
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movies, shopping information, games, multimedia documents, 
electronic commerce and many other services. A major problem in 
using these systems is to browse the enormous variety and 
quantity of possible choices to discover what is available, and 
5 to make a selection. By example, when surfing on the Web, 

a conventional method to navigate across many pages of hypertext 
documents consists of using search tools or invoking bookmarked 
links to the different required topics. When surfing on 
video-on-demand services, a conventional method to navigate is to 

10 surf on channels. Advertisements on preview channels are used as 
entry points to other movies. Users can navigate and make 
selections from a remote control using hierarchical menus. 
Obviously, these approaches does not allows a rapid access and 

5 browse of the thousands of multimedia documents that are 

13 available on the Web or interactive TV . 

I ; 

^ Present invention is based on the recognition of two 

w 

q significant facts: 

3! 

13 

,E • People are very skilled at browsing through paper catalogs, 
!« magazines, newspapers, maps and books by flipping through the 

Sb pages and glancing at pictures and text. 

i= * A collection of printed color photographs can be much easily 

and quickly browsed than a sequence of computer screens. Paper 
has a number of useful properties: 
• paper is easy to read, mark, and manipulate; 

25 • paper is portable, familiar and can be easily distributed. 

Many electronic systems attempt to replace paper by 
providing many advantages such as, for example, a better 
access to multimedia services. But, however most users prefer 
to work with paper. It is difficult to foresee, for example, 

30 the replacement in the future, of paper catalogs by electronic 

catalogs (e.g., by Web accessible catalogs). Publication 



DOCKET NUMBER FR920000022US1 




entitled "The Last Book", IBM Systems Journal, Vol 36, No. 3 
Vol 36, No. 3 - 1997, by J. Jacobson, B. Comiskey, C. Turner, 
J. Albert, and P. Tsao of the MIT Media Laboratory, compares 
printed books and computer screens in the following terms: 

"A book represents a fundamentally different entity than a 
computer screen in that it is a physical embodiment of a large 
number of simultaneous high-resolution displays. When we turn 
the page, we do not lose the previous page. Through evolution 
the brain has developed a highly sophisticated spatial map. 
Persons familiar with a manual or textbook can find 
information that they are seeking with high specificity, as 
evidenced by their ability to remember whether something that 
was seen only briefly was on the right side or left side of a 
page, for instance. Furthermore their haptic connection with 
the brain's spatial map comprises a highly natural and 
effective interface, when such information is embodied on 
actual multiple physical pages. 

Another aspect of embodying information on multiple, 
simultaneous pages is that of serendipity and comparison. We 
may leaf through a large volume of text and graphics, 
inserting a finger bookmark into those areas of greatest 
interest. Similarly, we may assemble a large body of similar 
matter in order to view elements in contrast to one another, 
such as might be done to determine which of a particular set 
of graphical designs is most satisfying" . 

Out of those advantages the most important problem, of 
course, with traditional printed books is that they cannot be 
changed, amended, updated nor completed. 
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During the last years, due mainly to the widespread use of 
personal computers and the universal access of millions of 
users to the World Wide Web, the "multimedia publishing" has 
veritably exploded. Due to the widespread penetration of 
5 CD-ROM drives an enormous amount of multimedia titles 

combining text, images and sounds, are now accessible to 
owners of personal computers. In this evolution, an incredible 
amount of hypermedia information is today accessible via the 
Internet on the World Wide Web. 

10 Even when the public ! s enthusiasm for new computer-based 

multimedia services has been seen by many analysts as a threat 
to the conventional forms of hard-copied publishing, 

n 

^ particularly book publishing, the real fact is that reading a 

05 book cannot be compared with reading an electronic media. 

13 Reading paper remains preferable for most people, whether they 

are familiar with computers or not. 

O 

L. • Touching directly the objects we have around is one of the 
simplest, most instinctive, and universal human actions. 

!^ Finger pointing and touching are the most natural form of 

human/machine interface. The action of touching is so simple 
and natural that navigating by means of touch screens require 
no training and no learning. In fact the pervasiveness 
robustness and versatility of the "touch technology" is 
transforming the way people are living, working, learning, and 

25 playing. The "touch technology" is successfully used in many 

different applications, by example: 

• In industrial environments: Environmentally-robust touch 
screens are increasing productivity under hazardous and 
hostile conditions that would cripple a standard Personal 
30 Computer and keyboard. 
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• In hospitals: Touch input helps doctors to prescribe 
medications to patients faster by allowing handwritten 
prescriptions . 

• In retail locations: Interactive, through-the-window 
displays let customers shop whenever they want, even when a 
store is closed. 

• In mobile and consumer devices: Touch and stylus input is 
the widely accepted input method for portable, and other 
mobile devices. 

• At tourist destinations: User-friendly kiosks are a 
cost-effective way to help travelers to get information and 
make their own reservations. 

The two main advantages of touching are: 

• Simplicity: Touching with the fingertip is the simplest and 
more intuitive form of pointing and selecting an item, and 

• Versatility: Touching is particularly adapted to 
applications where the use of a keyboard, a mouse or an 
optical pencil or stylus is not practical or is not well 
adapted to the user's service or comfort. 

Traditionally, a touch panel is integrated into the computer 
display. The touch panel and the display forms a combination 
called "touch screen". The input device is integrated into the 
monitor, so no space is wasted, and the interaction of the 
user with the system is made easier. The system guides the 
user by showing different choices in the form of icons 
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displayed on. the screen. When the user touches the icon of its 
choice, the associated action is executed. 

Therefore, there is a real need to provide the user with new 

systems and methods for improving printed texts with 

electronically stored data in the form of images, sounds and/or 
additional text. 

U.S. Patent 5,957,697 entitled "Printed Book Augmented with 
an Electronic Virtual Book and Associated Electronic Data", 
discloses a system and method for augmenting a printed text with 
electronically stored data in the form of images, sounds and/or 
additional text where a printed book comprising a plurality of 
pages of text is emulated by an electronic virtual book, that 
mimics the appearance of the printed book. This invention is 
based on the duplication of the paper book, on the creation of an 
electronic book over which links to hypermedia are defined and 
can be selected by the user. 

U.S. Patent 5,903,729 entitled "Method, System, and Article 
of Manufacture for Navigating to a Resource in an Electronic 
Network", discloses a method for navigating on an electronic 
network. The method comprises the steps of 

• forming an electronic image of an object having a plurality of 
markable regions associated with a plurality of electronic 
resources; 

• processing the electronic image to detect which of the 
markable regions associated with the plurality of electronic 
resources is marked; 

• generating a list comprising at least one link to at least one 
of the electronic resources whose associated markable region 
is marked, and 

• displaying a display screen based upon the list. 



DOCKET NUMBER FR920000022US1 



9 



This invention requires image scanning and image processing means 
to read marked regions on hard-copied documents. 

A similar approach using optical image scanners to access 
multimedia services is -described in U.S. Patent 5,640,193 
entitled "Multimedia Service Access by Reading Marks on an 
Object". This patent discloses an apparatus and a method to 
enable a user to control the selection of electronic multimedia 
services by means of a scanner for reading marks on an object and 
for communicating a request signal, having an object code 
representing the read marks, to a user interface. 

U.S. Patent 5,495,581 entitled "Method and Apparatus for 
Linking a Document with Associated Reference Information Using 
Pattern Matching" also uses image scanning and pattern matching 
techniques. This patent discloses an apparatus for linking a 
portion of a document with associated reference information, 
wherein the linked portion is designated by a predetermined 
attribute of the received document image, using among several 
other, a device for electronically scanning the electronic 
representation of the document image to locate said predetermined 
attribute of the document's image. 

U.S. Patent 5,905,251 entitled "Hand-held Portable WWW 
Access Terminal with Visual Display Panel and GUI-based WWW 
Browser Program Integrated with Bar Code Symbol Reader in a 
Hand-supportable Housing" discloses a portable hand-held WWW 
access terminal for accessing HTML-encoded documents located on 
the WWW. The terminal includes a bar code symbol reader in a 
hand-supportable housing for reading URL-encoded symbols 
specifying the location of HTML-encoded documents stored in 
information servers connected to the Internet and supporting the 
TCP/IP standard. This invention requires the marking of physical 
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documents with bar code symbols and requires bar code readers to 
trigger hyperlinks. 

Finally, a different approach for having an access to 
mutimedia services from physical documents is proposed in U.S. 
Patent 5,624,265 entitled "Printed Publication Remote Control for 
Accessing Interactive Media". This patent discloses a remote 
control system for an interactive media comprising a printed 
publication (such as a book, a magazine or a catalog), and one or 
a plurality of buttons physically attached to the printed 
publication to allow users to remotely control use of associated 
electronic content by a host device. 

None of the methods referenced in the prior art describes a 
system that would enable a user to get access to hypermedia 
services simply by touching with a fingertip an original, 
unmarked, hard-copied document (e.g., over an original edition of 
a rare ancient book) . 

From the prior art analysis, there is a real, uncovered 
need, for a system and a method for selecting and accessing 
multimedia information and/or services from different items 
(i.e., words, icons, figures, foot notes, etc.) printed on a 
book, a hard-copy publication or, more generally, on any type of 
physical document : 

• simply by touching the document with the fingertip, while, 
at the same time, 

• maintaining the integrity of the document. 

There is a need for not modifying a document using special marks 
or fonts to locate, identify or visualize the different items the 
user can select on the document. It would desirable to highlight 
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these items while preserving the integrity of the physical 
document . 

Aspscts of the Invention 

It is an aspect of the present invention to improve the 
5 current systems and methods of selecting and accessing 

electronic multimedia information or services. 

It is another aspect of the present invention to select and 
to access electronic multimedia information or services directly 
from a physical document. 

o 

y@ It is another aspect of the present invention to select and 

jjf access electronic multimedia information or services simply by 

H touching items on a physical document. 
-•0 

w 

Q It is another aspect of the present invention to create 

Q hyperlinks between items on the physical document and multimedia 

*ft information or services located on servers. 

m 
m 

P It is another aspect of the present invention to highlight 

said items while preserving the integrity of the document. 

Summary of the Invention 

The present invention discloses a method and system of 
20 selecting and accessing information or services by touching 
hyperlinked items on a physical document. The method, for use in 
a user system, comprises the steps of: 

• identifying a physical document, said physical document 
comprising one or a plurality of pages; 
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• identifying a page of said physical document, said page 
comprising one or a plurality of predefined hyperlinked items; 

• identifying position of hyperlinked items comprised in said 
identified page referring to a hyperlink table associated with 
said identified document, said hyperlink table comprising for 
each page of the document, a list of hyperlink items, and for 
each hyperlink item, an indication of its position on said 
page; 

• sending for visualization on an opto-touch foil, the position 
of said hyperlinked items, said opto-touch foil being 
connected to the user system. 

The method comprises the further steps of: 

• determining the position of a point pressed on said opto-touch 
foil; said opto-touch foil being placed and aligned over or 
under the identified page of the physical document; each one 
of hyperlinked items on said page corresponding to a 
visualized position on said opto-touch foil; said opto-touch 
foil being pressed at a point corresponding to a selected 
hyperlinked item; 

• identifying the selected hyperlinked item corresponding to the 
position of the point pressed on said opto-touch foil 
referring to the hyperlink table, said hyperlink table 
comprising an indication of the position of each hyperlinked 
item on the identified page; 

• identifying and locating information or service associated 
with the selected hyperlinked item referring to the hyperlink 
table, said hyperlink table comprising for each hyperlinked 
item of each page of the document the identification and 
location of the information or service associated with the 
hyperlinked item; 
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• acessing the information or service associated with the 
selected hyperlinked item. 

The present invention discloses a method and system of 
creating hyperlinks, by touching hyperlinked items on a physical 
document, for use in a user system. The method comprises the 
steps of: 

• creating a hyperlink table for a physical document; said 
physical document comprising one or a plurality of pages; 

• receiving and storing in said hyperlink table an 
identification of the physical document; 

for each page of said physical document: 

• receiving and storing in said hyperlink table an 
identification of the page and an identification of 
hyperlinked items defined by the user on said page; 

• receiving and storing in said hyperlink table identification 
and location of information or service associated with each 
defined hyperlinked item; 

• determining the position of points pressed on a opto-touch 
foil; said opto-touch foil being placed and aligned over or 
under the page of the physical document; said opto-touch foil 
being pressed at points corresponding to the position of said 
defined hyperlinked items; 

• storing the position of the points pressed in the hyperlink 
table, said hyperlink table comprising for each hyperlinked 
item, an indication of its position on the page. 
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The foregoing, together with other aspects, features, and 
advantages of this invention can be better appreciated with 
reference to the following specification, claims and drawings. 

Brief description of the drawings 

5 The novel and inventive features believed characteristics of 

the invention are set forth in the appended claims. The invention 
itself, however, as well as a advantageous mode of use, further 
aspects and advantages thereof, will best be understood by 
reference to the following detailed description of an 
10 illustrative detailed embodiment when read in conjunction with 
n the accompanying drawings, wherein : 

Figure 1 shows the main components of the invention. 

Figure 2 shows the internal structure of the opto-touch foil. 

Figure 3 shows an example of touch foil technology. 

Figure 4 shows an example of transparent light-emitting foil 
technology. 

Figure 5 shows the method of selecting and accessing Web pages 
from items illuminated on a physical document 

Figure 6 shows a physical document. 

Figure 7 shows how items are selected and how hyperlinks are 
created. 
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• Figure 8 shows how the opto-touch foil is placed on the 
document . 

• Figure 9 shows how the user presses the opto-touch foil over 
selected items. 

• Figure 10 shows how to use the opto-touch foil to enter the 
document reference number. 

• Figure 11 shows how to use the opto-touch foil to enter a page 
number and how selected items are illuminated. 

• Figure 12 shows how the user presses the opto-touch foil over 
illuminated items. 

• Figure 13 shows how the information related to the item 
selected by pressing the opto-touch foil placed over or under 
the document is displayed. 

• Figure 14 is a flow chart of the method of creating hyperlinks 
on a physical document. 

• Figure 15 is a flow chart of the method of triggering 
hyperlinks on a physical document. 

• Figure 16 shows a paper map of Miami MetroMover placed under 
an opto-touch foil. 

Advantageous embodiment of the Invention 
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The present invention discloses a system and method for 
selecting and accessing multimedia information and/or services 
located on a user workstation or on one or a plurality of servers 
connected to a communication network simply by touching with a 
5 finger items (words, letter, symbol, pictures, icon, . ...) that 
are electronically illuminated over the surface of a hard-copy 
document or any other physical surface. The system includes: 

• an opto-touch foil preferably transparent, placed by the user 
over (or under) the document (or a portion of said document) . 
10 This opto-touch foil is used : 

• to illuminate and highlight hyperlinked items over the 
n surface of the physical document (or portion of the 

*S document) , and 

in 

,p • to read coordinates of these hyperlinked items, 

P • an user workstation for accessing the information and/or the 

UJ service associated with the hyperlinked items. 

□ For identifying and selecting, said hyperlinked items, these 

ass 

J hyperlinked items are automatically illuminated by a luminous 
iH signal (or light spot) generated by the opto-touch foil. The 
j!Z0 opto-touch foil operates under the control of the user 
workstation. Illuminated items are selected by pressing the 
opto-touch foil. When the user selects an item among all 
illuminated items, the user workstation receives from the 
opto-touch foil a signal indicating the position of this selected 
25 item. The user workstation identifies and locate referring to a 
hyperlink table the information and/or the service associated 
with the position of the selected item. If the information and/or 
service is located in a remote server, a request is sent to this 
server. If the information and/or the service is stored in the 
30 user workstation, then this information and/or service is 
accessed locally. 
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In a particular embodiment, the user workstation is 
connected to the Internet network and comprises a Web Browser 
application. Servers are Web servers and the information or/and 
the service are Web pages linked to the items illuminated on the 
physical document and selected by the user when pressing the 
opto-touch foil on the corresponding point illuminated on the 
document . 

In a advantageous embodiment, the opto-touch foil is built 
by stacking a transparent resistive or capacitive film, of the 
type commonly used to manufacture touch screens over a 
transparent organic light emitting device film (TOLED film) . 

SYSTEM FOR SELECTING AND ACCESSING MULTIMEDIA INFORMATION 

As shown in Figure 1, the system according to the present 
invention comprises: 

• (101) A hard-copy document (e.g., a book) comprising one or 
a plurality of pages. 

• (102) An opto-touch foil connected to a user workstation. 
The opto-touch foil is to be placed over or under a page (or 
a portion) of the document. 

• (103) A user workstation (preferably connected to a 
communication network) for accessing and displaying 
multimedia information and services. 

Physical Document 

The physical document (101) can be of any kind, for example, 
a newspaper, a geographic map, a novel book, a text book, a 
technical book, a commercial catalog or even any other type of 
engraved, written, or printed surface (e.g., a painting in a 
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museum of art) . The material of the document can be paper, 
plastic, wood or any other material. 



Opto-Touch Foil 

The opto-touch foil (102) comprises two, functionally 
independent, transparent foils, namely: 

• a touch foil, and 

• a light emitting foil (opto foil) . 

Figure 2 shows the cross section of an opto-touch foil (200) 
comprising : 

• a transparent resistive or capacitive touch foil (201), of 
the type used commonly to manufacture touch screens. The 
generated signal is generally proportional to the 
coordinates of the point that is pressed or touched (203), 

• a transparent light emitting foil (202), which is a 
transparent, bright, self-emitting display that can emit 
light (204) from either one or both surfaces. 

The combination of both foils (i.e., the touch foil stacked over 
the light emitting foil) forms an opto-touch foil (200) . Figure 2 
represents an opto-touch foil placed and aligned over a physical 
document (205) comprising a plurality of items (206) (i.e., 
words, pictures, icons, etc.) printed (or written, painted, 
engraved . ..) on its surface. 
Touch Foil Technology 

^ ^fk^touch foil component (201) may be made of transparent 
resistive or^^Hpacitiye films of the type used commonly to 
manufacture touch screer^ signal is generally 

proportional to the coordinates oftftfcHS^int pressed. One example 
of touch foil technology it would be possi^rte^to use, is the 
TouchTek4 (4-wire Analog Resistive Touchscreens) ot>IiQRO TOUCH 
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company(T£rttsk£e^ is a trademark of the MICRO TOUCH Company) . 
The TouchTeck4 techricnr^^ fully described in the Web site of 

MICRO TOUCH Company at http : //wwwTmia^ot ouch. com/. 



As illustrated in Figure 3, TouchTek4 touch screens (310) 

5 use a a polyester sheet (301) with a conductive coating (302) as 

a vertical conductive electrode, providing one-half of a touch 

coordinate. The topsheet (300) is separated from the bottom 

layer, a glass substrate (304) with a conductive coating (303), 

by spacer dots (305) . The bottom sheet (306) is attached to the 

10 topsheet (300) by means of an adhesive (309) . The bottom sheet 

(306) forms the horizontal conductive electrode, generating the 

second half of the touch coordinate. Silver bussbars located on 

the topsheet (307) and on the bottom sheet (308) pass the touch 

G9 coordinates to the touchscreen controller. TouchTek4 touchscreens 

ljS feature hard-coated polyester topsheets (300), available in 

*0 several surface finishes. Spacer dots (305) are available in 
hi 

Q several dot arrays, optimized for finger, pen and finger, or 

;^ pen-only input. The conductively-coated glass bottom sheet (303, 

i | 

j£ 304) is available in several thicknesses. Electronic control is 

*i 

f| provided by a serial controller, or by 4-wire controllers. 

□ TouchTek4 ' s specifications include narrow inactive border areas 

^ and compact touch sensors which allow system designers and OEMs 
to provide the largest useable screen area and full • mouse 
emulation without sacrificing functionality or consuming excess 

25 power. Apart from being suited for implementing the touch foil 
functions of this invention, TouchTek4 touchscreens are commonly 
used in hand-held personal information management systems, PDAs, 
mobile computing systems, automotive, diagnostics and telecom 
devices, and Internet appliances. TouchTek4 touchscreens are 

30 engineered to accept more than three million touches to any area 
of the screen. 
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Light Emitting Foil 

\The light emitting foil may be made of an array of TOLED' s 
(Transparent Organic Light Emitting Devices), of the type used 
today to cbaate vision area displays on windshields, cockpits, 
helmets and ey^^asses. TOLED displays, which can be up to 85% 
transparent when not: energized are today manufactured with 
standard silicon semic^r^uctors . One example of light emitting 
foil technology it would b^possible to use is the technology 
used for the TOLEDs manufactured by UNIVERSAL DISPLAY 
CORPORATION. The TOLED technology ibv fully described in the Web 



As illustrated in Figure 4, in its most basic form, a TOLED 
is a monolithic, solid-state device consisting of a series of 
"small molecule" organic thin films sandwiched between two 
transparent, conductive layers. As a result, TOLEDs are bright, 
self-emitting displays that can be directed to emit from either 
or both surfaces. This is possible because, in addition to having 
transparent contacts, the organic materials are also transparent 
over their own emission spectrum and throughout most of the 
visible spectrum. Typically, a transparent conductive material 

(402), e.g., indium tin oxide (ITO), for hole-injection is 
deposited directly onto a glass substrate (401) . Then, a series 
of organic materials are deposited by vacuum sublimation on the 
ITO layer: The first organic layer (403) serves as a 
hole-transporting layer (HTL) and the second layer (404) serves 
as both a light-emitting (EL) and electron-transporting layer 

(ETL) . Finally, a transparent top contact (405) is deposited for 
electron injection on top of the organic films. When a voltage 

(406) is applied across the device, it emits light. This light 
emission is based upon a luminescence phenomenon wherein 
electrons and holes are injected and migrate from the contacts 
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toward the organic hetero junction under the applied electric 
field. When these carriers meet, they form excitons 
(electron-hole pairs) that recombine radiatively to emit light. 

TOLEDs are thin-film, solid-state devices, so they are very 
thin, lightweight and durable, ideal for portable applications, 
like the one disclosed in this invention. TOLEDs can be bottom, 
top, or both bottom and top emitting. Also, TOLEDs technology has 
attractive advantages regarding, transparency (TOLED displays can 
be nearly as clear as the glass or substrate they're on and when 
built between glass plates, TOLEDs are > 80% transparent when 
turned off), energy efficiency (for longer battery life), full 
viewing angle, bright and high contrast light emission, fast 
response time, and environmental robustness. Thus, TOLEDs are 
well suited for manufacturing the light emitting foil component 
used jointly with the touch foil according to the present of 
this invention. 

User Workstation 

The user workstation (103) is used to access information 
and/or services stored locally or located on one or a plurality 
of servers connected to the network. The user workstation may be, 
for example, an Internet appliance, a multimedia Personal 
Computer (PC), a set-top box, a TV monitor, a game console ... 
The opto-touch foil may communicate with the user workstation by 
means of a cable, a wire pair, an infrared link, or a wireless 
radio link. 

Information and/or Service Access 

When the user goes to a new portion of a document (101) (a 
new page of a book for example), he places the opto-touch foil 
(102) over (or under) the selected portion and enter in the 
workstation the reference of this portion (the page number) . In 
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a advantageous embodiment, the page number can be entered simply 
by touching some buttons marked on the top (or bottom) of the 
opto-touch foil. The page number may be also entered directly by 
means of the keyboard, the mouse or the touch screen of the user 
5 workstation or by any other means such as a bar code reader . . . 
The hyperlinked items (items that can be selected to access 
information on a server) on this page, are then automatically 
illuminated and highlighted on the surface of the document by the 
light emitting foil. This light emitting foil operates under the 
10 control of the user workstation (103) . This illumination and 
highlighting allows the localization and identification of all 
hyperlinked items on the page selected by the user. 

j« In order to retrieve and display a multimedia information or 

"as? 

W to access a multimedia service associated with an illuminated 

lS item on a document (101), the user touches with its finger or 

*0 exercises a pressure on the portion of the opto-touch foil (102) 
fii 

□ placed over the illuminated item he wishes to select. The 
position of the illuminated item selected on the opto-touch foil 
E is used to identify and locate the server and the information 

"7™ 

M within this server the user wants to access. The user workstation 
p (103) then accesses the identified server and retrieves and 
^ displays the information or/and service associated with the 
selected illuminated item. 

WORLD WIDE WEB 

25 In the particular embodiment of the invention shown in 

Figure 5, the user workstation (500) is connected to the Internet 
network (501) . The user workstation comprises a user interface 
(502) including a Web Browser (503) (also called "Web Client") to 
access the World-Wide-Web (WWW) . In order to access the Web 

30 pages associated with an illuminated item (508) on a document 
(509), the user touches with its finger (506) the opto-touch foil 
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(507) over the illuminated item (508) he wishes to select. The 
position of the illuminated item selected on the opto-touch foil 
identifies the Web server (505) and the Web pages the user wants 
to retrieve and display. The Web Browser program (503) sends a 
HTTP request (504) to the identified Web Server (505) . The 
response to the request (HTTP response) is sent by the Web Server 

(505) in the reverse direction to the Web Browser (503) . The HTTP 
response comprises the requested Web pages associated with the 
selected illuminated item. 

SELECTION AND ACCESS TO INFORMATION OR/AND SERVICES ON SERVERS 
A) Creating Hyperlinks on a Physical Document 

As shown in Figure 14, the method for creating hyperlinks 
from a hand written or printed document (like the document shown 
in Figure 6 entitled "Early British Kingdoms") , to a plurality of 
servers to access multimedia information or services, comprises 
the steps of: 

• (1401) assigning a reference number (identifier) to the 
document; 

and for each page of the document (or portion of the document) : 

v 

• (1402) selecting items-on the page; 

• (1403) creating hyperlinks between these selected items and 
information and/or services located on servers; 

• (1404) placing and aligning an opto-touch foil over the 
page; 

• (1405) pressing the opto-touch foil over selected items on 
this page; 



DOCKET NUMBER FR920000022US1 



24 



• (1406) reading and storing in an hyperlink table the 
position (coordinates) of selected items on this page. 

(1401) Assigning a Reference Number to the Document 

As shown in Figure 6, for each document he receives, the 

user : 

• assigns a reference number to this document (e.g., 387) for 
identifying said document. 

• writes this reference number on the document, and 

• creates an hyperlink table associated with the document and 
accessible from the workstation, said hyperlink table 
comprising the reference number of the document and other 
relevant information related to the document such as title, 
author, ISBN (International Standard Book Number), date,- 
etc... The hyperlink table may be stored within the user 
workstation or may be stored in an external memory 
accessible from the user workstation. 

The header of the new created hyperlink table associated with the 
document shown in Figure 6, can be built as follows: 



Doc: 0387 


Title: "Early British 
Kingdoms " 


Author: David Nash Ford of Binfield, 
Berkshire, UK 




Date: 28 / 01/ 2000 


ISBN: 84-344-08-56-2 








X= 1 
Y= 


Link: 





(1402) Selecting Items on Pages of the Document and (1403) 
Creating Hyperlinks 
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As shown in Figure 7, each time the user wants to create an 
hyperlink for an item (701) located on a page of a document, he: 



10 



enters the page number (702) where the item is referenced in 
the hyperlink table of the document (e.g., 16); 
associates with this item a destination address within the 
communication network, this destination address identifying 
a server connected to the communication network and the 
information and/or services within this server the ■ user 
wants to access; 

enters the destination address associated with this item 
(e.g., an URL address for example) in the hyperlink table. 




advantageous embodiment, the hyperlink table associated with 
hown in Figure 7, appears as follows: 



Doc: 0387 


Title: ^arly British 
Kingdoms 


Author: David Nash Ford of Binfield, 
Berkshire, UK 




Date: 28 / 01^2000 


ISBN: 84-344-0856-2 


Pg: 16 






X= 1 
Y= 


Link: Mabinogion V 


http : //www. cyberphile. co.uk/-taf f/taffnet/mabinogi 
on/mabinogion . htm 


X= 1 
Y= 


Link: Aval on 


htT^D : / / f reespace .virgin . net/david . f ord2/avalon . htm 

i \ 


X- | 
Y= 


Link: Afallach 


http://f>^espace .virgin . net/david . ford2/gods .htmlff 
Afallach 


X= 1 
Y= 


Link: Beli Mawr 


http: //freespacX^vi^gin. net/david. ford2/gods . html# 
Beli 



o 



15 



20 



may be stored locally in the user workstation, lathis case, an 
identification within the user workstation of the ih<ormation or 
service (local address, file name, exec name . ..) is entered in 
the hyperlink table. 



(1404) Placing and Aligning the Opto-touch Foil over a Page of 
the Document 
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As shown in Figure 8, after the hyperlinked items of a page 
have been defined in the hyperlink table associated with the 
document, the opto-touch foil is: 



• placed over (or under) the page, and 

• aligned with the borders of this page by some conventional 
means (e.g., by adjusting the upper left corner of the 
opto-touch foil with the upper left corner of the page) . 

(1405) Reading the Coordinates of the Hyperlinked Items 



As shown in Figure 9, for each item previously selected on 



the page {"Mabinogion' 



"Avalon' 



"Afallach' 



'Beli Mawr" 



the 




user presses (e.g., by the finger tip) the opto-touch foil on the 
corresponding item to determine the position (for instance, the 
coordinates) of this item on the page. 



the measure of the coordinates of each selected item 
hyperlinkeiJ^tem) on the page is completed, the hyperlink table 
is updated as follr**Ls: 




Doc: 0387 


Title: "Early 
British Kingdoms" 


Author: David Nash Ford of Binfield, Berkshire, 
UK *^s^ 




Date: 28 / 01/ 2000 


ISBN: 8X^44-0856-2 


Pg: 16 






X= 30 1 
Y= 95 


Link: Mabinogion 


http: / /www. cyberj^KUe . co.uk/-taff/taffnet/mabmogion/ 
mabinogion.htm ^s,^ 


X=255 I 
Y=150 


Link: Avalon 


http: // f reespace. virgin. r>s^/david. ford2/ avalon . html 


X=225 I 

y=i60 


Link: Afallach 


http: / /f reespace. virgin, net /davi^f ord2/gods .html #Af a 
llach \^ 


X=190 | 
Y=230 


Link: Beli Mawr 


http : / / f reespace . virgin . net/david . ford?Sqods . html ff Bel 
i ^s,^ 



For example, on page 1 6 a^document 387 entitled "Early British 
Kingdoms" written by David Nash^Ford of Binfield, the coordinates 
of the hyperlinked word "Mabinogt&n" are X=30 / Y=95. This 
hyperlinked word "Mabinogion" points^^to the URL address 
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ftfctp : //www . cyberphile . co . uk/-taf f /taf f net/mabinogion/mabinogion . h 

Ussing the herein described method for the different pages of 
a same document, the hyperlink table would appear like this: 



Doc: 0378 


Title: "Early British 
Kingdoms " 


Author: David Nash Ford of Binfield, 
Berkshire, UK 




Date: \28 / 01/ 2000 


ISBN: 84-344-0856-2 


Pg: 3 






X=45 I 
Y=130 


Link: BUtellt & 
Gwerthryn\on 


http: //f reespace.virgin.net/david. ford2/buel 
lt.html 


X=205 | 
Y=170 


Link: Caer^addan 
(Bath) \ 


http: //freespace. virgin.net/david. ford2/sout 
h Hi-mi am ou-i 

11 • XI LULL ftalUUJ. 


A — / J 1 

Y=190 


Liink : Caer~Celsmion 
(Silchester) \ 


http: //freespace. virgin.net/david. ford2/vort 
igern.html 


X=110 | 
Y=255 


Link: CeredigionV 


http: //freespace. virgin.net/david. ford2/cere 
digion.html 








Y=2 60 


Link: Editor Phone \ 
Number \ 


Phone: //54-26-555-1234 








Pg: 16 






X= 30 I 
Y= 95 


Link: Mabinogion 


h^tp: //www. cyberphile. co. uk/~taf f /taf fnet/mabinog 
ionVmabinogion . htm 


X=255 | 
Y=150 


Link: Aval on 


http :V/ freespace . virgin, net /david . f ord2/avalon . ht 
ml \ 


X=225 | 
Y=160 


Link: Afallach 


http: //rVeespace. virgin . net /david. ford2/gods . html 
#Afallach\ 


X=190 | 
Y-230 


Link: Beli Mawr 


http: / /free>*r)ace. virgin, net /david . ford 2 /gods . html 
#Beli \ 














Pg: 39 






X=25 | 
Y=30 


Link: St . Joseph of 
Arimathea 


http://freespace.virgin.net/david.ford2/jose 
ph . html \ 


X=80 I 
Y=75 


Link: The Kings of 
Dumnonia 


http :/ /freespace . virgin . net /david . ford2 /dumn 
onia.html \ 


X=140 | 
Y=135 


Link: Eudaf Hen & Conan 
Meri 


http: //freespace . virginSnet/david. f ord2/euda 
nc . html \ 









Several types of multimedia services can be defined in the 
hyperlink table using different types of codes to identify 
service names and service addresses (e.g., http:// address to 
access an URL address on the Internet; Phone:// address to make a 
phone call, etc.). All these multimedia services can be accessed 
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and retrieved from the Web simply by touching the opto-touch foil 

over the corresponding items highlighted on the hard-copy 
document . 

B) Triggering Hyperlinks from a Physical Document 

5 The user receives a hand written or printed document, like 

the document entitled "Early British Kingdoms" t (Doc: 387) shown 
in Figure 6. Hyperlinks have been previously defined from items 
selected on pages. As shown in Figure 15, the method of locating, 
visualizing and highlighting hyperlinked items, of triggering 

10 hyperlinks and of accessing information and/or services directly 
i*s from these hyperlinked items highlighted on the pages of a 
*G physical document comprises the steps of: 

m 

r- 

^ • (1501) selecting a document by entering the reference number 

y of this document; 

15 • (1502) selecting a page of the document; 

O • (1503) identifying for the selected page the position of 

:fj predefined hyperlinked items referring to a hyperlink table 

IJ1 associated with the selected document, said hyperlink table 

11 comprising for each page of the document, a list of 
20 hyperlink items, and for each hyperlink item, an indication 

of the position on an opto-touch foil; 

• (1504) illuminating (or visualizing, or highlighting) the 
position corresponding to each of said predefined 
hyperlinked item by means of an opto-touch foil connected to 

25 the user workstation; 

• (1505) placing and aligning the opto-touch foil over (or 
under) the selected page; 

• selecting an hyperlinked item on this page by pressing the 
opto-touch foil on the illuminated point (light spot) 

30 corresponding to the item; 
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• determining the position of the point pressed on the 
opto-touch foil; 

• (1508) identifying the selected hyperlinked item referring 
to the hyperlink table, this hyperlink table comprising an 

5 indication of the position of each hyperlinked item 

(illuminated item) on the selected page of the document; 

• (1509) identifying the information or/and the service 
associated with the selected illuminated item referring to 
the hyperlink table, this hyperlink table comprising for 

10 each illuminated item of the selected page the 

identification of the requested information and/or service 

within the user workstation or within the network 

4 ~ (preferably by means of a destination address) ; 

Q 

*8 • (1510) accessing the information and/or service; 

It • (1511) retrieving and displaying this information and/or 

"T" 

service on the user workstation. 

ill 

J so. 

P (1501) Entering the Reference Number of the Document 

i y 

bl Bv means of any user interface (keyboard, mouse, touch 

screen, . . . ) or any reading means (bar code reader . . . ) , the user 

20 enters the reference number (identifier) of the document (e.g.: 
document 387) he wants to select. In the particular embodiment 
shown in Figure 10, the user enters the reference number of the 
document (e.g.: Doc: 387) by means of an array of pressure 
sensible "touch buttons" printed on the top of the opto-touch 

25 foil. The user presses in the following order: 

• a touch button marked "Doc, and then 

• numerical touch buttons corresponding to each digit of the 
document reference number (e.g., "3", "8" and "7"). 
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This procedure gives access to the hyperlink table 
associated with this selected document. 

(1502) Selecting a Page and Highlighting Hyperlinks on this Page 

means of any user interface (keyboard, mouse, touch 
screen . .^Xor any reading means (bar code reader ...),, the user 
enters the pag^of the document (or the portion of the document) 
(e.g.: page 16) heNi^nts to select. In the particular embodiment 
shown in Figure 11, b^jieans of the array of pressure sensible 
10 touch buttons printed on theHqp of the opto-touch foil, the user 
enters the page number to select^H^-g. : Pg. 16). The opto-touch 
foil can be on any position (normal^^ttie opto-touch foil is 
IB placed over the page comprising the hyperh^ to trigger) . The 
jl user presses in the following order: 

ijg • a touch button marked as "Pg", and then 

L • numerical touch buttons corresponding to each digit of the 

y 

42 page number (e.g., "1" and "6" ) to select. 

m 

!J1 

P This procedure gives access to the selected page (e.g., Pg. 

16) within the hyperlink table associated with the selected 
20 document (e.g., Doc: 387). 

(1503) Identifying the Position of Predefined Hyperlinked Items 
referring to the Hyperlink Table 

The position (coordinates X and Y) of all the hyperlinked 
items previously defined for the page selected by the user are 
25 retrieved from the hyperlink table and sent by the user 
workstation to the opto-touch foil. 
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(1504) Illuminating the Position Corresponding to each of said 
Predefined Hyper linked Item 

The opto-touch foil receives the information sent by the 
user workstation. This information comprises the position 
5 (coordinates X and Y) of each hyperlinked item defined on the 
selected page. The opto-touch foil decodes this information and 
visualize (highlights or illumines) the position of each of the 
hyperlinked items. 

(1505) Placing and Aligning the Opto-touch Foil over the selected 
10 Page of the Document 

□ 

%0 Once a document and a page have been selected, the 

m 

]h opto-touch foil generates one or a plurality of light spots 

H; signaling that one or more . hyperlinks have been defined for this 

y page. Then, the opto-touch foil is: 

O 

it 

Q • placed over (or under) the page, and 

£ • aligned with the borders of the selected page by some 
111 conventional means (e.g., by adjusting the upper left corner 

" of the touch foil with the upper left corner of the page) . 

As shown also on Figure 11, the opto-touch foil is placed and 
20 aligned over the selected page. The position of the light spots 
emitted by the opto-touch foil corresponds to the position of the 
hyperlinked items defined for this page. The hyperlink items 
appear through the transparent opto-touch foil and are identified 
by the user thanks to the light spots emitted by the opto-touch 
25 foil. 

(1506) Selecting an Illuminated Item on this Page 
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As shown in Figure 12, the user selects an (hyperlinked) 
item {"Afallach") on the page by pressing (e.g., by means of his 
fingertip) the opto-touch foil on the illuminated point 
corresponding to the selected item. 

(1507) Determining the Position on the Page of the Point Pressed 
on the Opto-touch Foil 

The opto-touch foil sends a signal to the user workstation 
to identify the selected item. This signal indicates the position 
on the page of the point that has been pressed by the user on the 
opto-touch foil. The generated signal is generally proportional 
to the coordinates (X/Y) of the point that has been pressed. 

In our example, the opto-touch foil measures the position on 
the page of the point that has been pressed (near the light spot 
over the word "Afallach") by the user. The coordinates that are 
measured at this point are around X=225 and Y=160. 

(1508) Identifying the Selected Item 

The illuminated item selected on the opto-touch foil by the 
user is identified thanks to the hyperlink table. The hyperlink 
table comprises an indication of the position (coordinates X and 
Y) of each illuminated item on each page of the document. 

In our example, the coordinates measured by the opto-touch 
foil are around (close to) X-225 and Y=160. They corresponds in 
the hyperlink table to the hyperlinked item "Afallach" . 

^43i£h^yperlink table is either stored locally in the user 
workstationT^or"^^ from a remote server and then stored 

locally in the use| workst^i^m^ in a remote server 

and is accessed remotely . 




(1509) Identifying the Information Associated with the Selected 
Item 
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The hyperlink table comprises for each hyperlinked 
(illuminated) item of each page of the document the location 
within the network of the requested information and/or service. 
The information and/or service may be located by means of a 
destination address. In the Internet network, Web pages in Web 
Servers are identified by an URL (Uniform resource Locator) . 

ur example, the hyperlink table associates the 
illuminated iteltr — ^"Afallach" with the URL 

http : //freespace . virgin . net/davl3Tford2/gods . html#Afallach . 



r 



10 



(1510) Accessing the Information and/or Service 




it" 



20 



The user workstation Web triggers the hyperlink (destination 
address, URL, . ..) associated in the hyperlink table, with the 
identified selected item. 

our example, the hyperlink labeled "Afallach" is 
triggered^^s^nce the system determines v from the hyperlink table 
that, for this^p^ge (i.e., Pg. 16), X=225, Y=160 are the 
coordinates of the nea>ast hyperlink to the sensed position. 
Thus, in this example, a simp^rs^pressure near the illuminated 
item "Afallach" will automaticalI>>^trigger the following 
hyperlink on the Web: 

http : //freespace . virgin . net/david. ford!/ gods . html#AfaI-ia.ch 



(1511) Retrieving and Displaying the requested Information and/or 
Service 



The information contained at the selected destination 
25 address (URL) can be displayed on the user workstation. As shown 
in Figure 13, additional information (e.g., document number, page 
number, hyperlinked item, foil coordinates and URL) related to 
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the hyperlinked (illuminated) item selected by the user can be 
shown on the Web Browser along with the information retrieved 
from the Web Server. 

ALTERNATIVE APPLICATIONS 

Other several possible applications of the present invention 
are described below. Each of these applications basically use 
the same previously described method and system. 

Installation and Engineering Instructions 

A customer receives a complex computer equipment, with an 
installation manual comprising drawings and schemes of the parts 
and subassemblies. With the opto-touch foil over any one of these 
schemes, the user can immediately see certain parts of the 
complex scheme illuminated by means of bright spots. These 
illuminated parts are identified as hyperlinks items and can be 
used for accessing additional information on a remote Web server 
or on a local computer. When the customer touches one of those 
illuminated items, multimedia instructions to show how the part 
needs to be installed or serviced are instantly displayed. It is 
no more necessary to look through printed manuals to discover how 
a part is called and what to do with it. Furthermore, the 
customer does not need anymore to navigate on a computer terminal 
among different alternatives paging through multiple menus and 
choices and loosing the attention on the general picture and 
friendliness of the installation manual. A single printed copy of 
a general view of the equipment is sufficient to navigate with 
the system according to the present invention. The customer has 
just to press with his finger on the desired illuminated item on 
the surface of the installation manual. 
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Newspapers and Magazines 

A subscriber reading a newspaper or magazine, may be 
interested in seeing computer multimedia or TV video information 
associated with the articles he reads. While reading the sports 
5 pages (e.g., on the New York Times), key events can be instantly 
recalled and played on demand (e.g., the opening ceremony of 
Melbourne Olympic Games, the last images of the "Tour de 
France", the last tennis match on Winbledon, etc..) simply by 
touching a highlighted icon, word, letter, symbol ...on a page of 
10 the newspaper. 

Paper-based Advertising Linked to On-demand Multimedia Ads 

i tss k 

3 Today, many free-toll calls originate from people reading 

W advertisements in newspapers or magazines or in direct mail ads. 
\L According to the present invention, people can instantly access 
multimedia presentations simply by touching the ads that have 
p drawn their attention. 

Q 

s p Courses and Textbooks 

!H Extensive reading is easier to do on paper, but animated 

P video explanations and demonstrations are much more effective for 
20 some purposes. The two can be tied together by placing 
hyperlinked items in a textbook. These hyperlinked items can, for 
example, link the textbook to live discussion groups with other 
students or to live interactions with professors and tutors. 



25 PARTICULAR APPLICATION 

Hypermedia Access from a Paper Map 

In the example shown in Figure 16, a map (e.g., a paper map 
of the MetroMover of Miami, Florida) is placed and aligned 
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underneath the opto-touch foil. By pressing the opto-touch foil 
over any hyperlinked station (e.g., "illuminated" by a small 
circular light spot on the opto-touch foil : "Freedom Tower", 
"Financial District", "Government Centre", . ..), the hypermedia 
5 information of this station (i.e., the information related to the 
station selected on the map) is retrieved from the Web and 
displayed on the user workstation. This workstation may be 
installed, for example, on walls of any metro station. 

Apart from the herein described applications, there are many 

10 other possible applications of this invention. For example, the 
same paper catalog can be published (by the service provider or 
by third parties) for individuals having different focus of 

'2 interest. Old movies, westerns, or multi-user interactive games 

IB can be differently highlighted on the same catalog. Phone numbers 

lj or phone icons can be highlighted on newspaper advertisements, 

*G magazines, books and pamphlets, allowing customers to make 

11 toll-free phone calls simply by touching an illuminated point on 
Si an opto-touch foil. Home shopping retailers can provide catalogs 
p of specialties. They can highlight special offerings and 

i"y promotions. Distance learning applications can access rich 
p content images or movies to complement the illustrations of 
i 8 * student's books, etc... 

What has been described is merely illustrative of the 
application of the principles of the present invention. Other 
25 arrangements and methods can be implemented by those skilled in 
the art without departing from the spirit and scope of the 
present invention . 

The present invention can be realized in hardware, software, 
or a combination of hardware and software. The present invention 
30 can be realized in a centralized fashion in one computer system, 
or in a distributed fashion where different elements are spread 
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across several interconnected computer systems. Any kind of 
computer system - or other apparatus adapted for carrying out the 
methods described herein - is suitable. A typical combination of 
hardware and software could be a general purpose computer system 
5 with a computer program that, when being loaded and executed, 

controls the computer system such that it carries out the methods 
described herein. The present invention can also be embedded in a 
computer program product, which comprises all the features 
enabling the implementation of the methods described herein, and 

10 which - when loaded in a computer system - is able to carry out 
these methods. 

Computer program means or computer program in the present 

% context mean any expression, in any language, code or notation, 

63 of a set of instructions intended to cause a system having an 
C 

11 information processing capability to perform a particular 

a 

% fl function either directly or after conversion to another language, 

j s j| 

h code or notation and/or reproduction in a different material 
s! form. 

p 

11= It is noted that the foregoing has outlined some of the more 

m 

|<j) pertinent aspects and embodiments of the present invention. This 

M" invention may be used for many applications. Thus, although the 
description is made for particular arrangements and methods, the 
intent and concept of the invention is suitable and applicable to 
other arrangements and applications. It will be clear to those 

25 skilled in the art that other modifications to the disclosed 

embodiments can be effected without departing from the spirit and 
scope of the invention. The described embodiments ought to be 
construed to be merely illustrative of some of the more prominent 
features and applications of the invention. Other beneficial 

30 results can be realized by applying the disclosed invention in a 
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different manner or modifying the invention in ways known to 
those familiar with the art. 
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